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Neyman, 1936) is used to determine areas of significant difference in a 
criterion variable between two or more groups in situations of linear 
regression. In using this technique, researchers have encountered 
difficulties with results, possibly related to the J-N technique's 
sensitivity to violations of certain assumptions and conditions. For this 
study, Monte Carlo simulations were performed to determine the effect that 
sample size and variance have on the J-N technique. The simulations examined 
the hypothesis that unequal ratios of sample size and variance between two 
groups may create anomalies in the results of the J-N computation. The 
results do not show anomalies in the output, and further show that the J-N 
technique produces wider regions of significance as the total sample size 
increases. The size of variance ratios, as well as the equality of variance 
and sample size ratios, did not seem to affect the results dramatically. 
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Abstract 



The Johnson-Neyman (J-N) technique is used to determine areas of significant difference 
in a criterion variable between two or more groups in situations of linear regression. Iir 
utilizing this technique, researchers have encountered difficulties with results, possibly 
related to the J-N technique’s sensitivity to violations of certain assumptions and 
conditions. For this study, Monte Carlo simulations were performed to determine the 
effect that sample size and variance have on the J-N technique. The simulations examined 
the hypothesis that unequal ratios of sample size and variance between two groups may 
create anomalies in the results of the J-N computation. The results did not show 
anomalies in the output, and further showed that the J-N technique produces wider 
regions of significance as the total sample size increases. The size of variance ratios, as 
well as the equality of variance and sample size ratios did not seem to affect the results 
dramatically. 
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The Effect of Sample Size and Variance on the Johnson-Neyman Technique 
The Johnson-Neyman technique (Johnson & Neyman, 1936) is a procedure that is 
employed to determine regions of significant difference in a criterion variable, wliich 
exist as a function of one or more predictor variables in a linear regression situation. The 
regions of significance are areas in which criterion variable values differ significantly 
between groups (on the y-axis), and are defined in terms of the predictor variable (on the 
x-axis). To better understand the Johnson-Neyman technique and its use, consider the 
following hypothetical example. Researchers interested in positive reinforcement and its 
effect on academic performance design a study . They hypothesize that there is a direct 
correlation between the amount of positive reinforcement given to students and the 
amount of grade improvement the students will show. In tliis case the predictor variable 
would be positive reinforcement and the criterion variable would be academic 
performance (grades). Thus, academic performance could be plotted as a function of 
positive reinforcement. 

Suppose, however, that the researchers further hypothesized that females will 
show a significantly higher improvement (due to a high amount of positive 
reinforcement) in grades than males, and that they will show a significantly smaller 
amount of improvement than males when little positive reinforcement is given. In this 
case separate regression lines for males and females could be plotted, again showing 
academic performance as a function of positive reinforcement. The researchers notice diat 
their graph shows male and female grades are virtually the same when a moderate amount 
of positive reinforcement is given. Males and females differ, however, in grades outside 
of this area of moderate reinforcement. In fact, the graph proves their hypothesis diat 
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females would show more improvement with increased positive reinforcement and less 
improvement with a decreased amount of positive reinforcement, with the male and 
female regression lines forming an “X” pattern (See Figure 1). At what points along .j- 
predictor variable axis (x-axis) are the two lines sigmficantly different with respect to the 
criterion variable (y-axis)? This is a question that is best answered by the Johnson- 
Neyman (J-N) technique. Using the J-N technique will answer the question of how much 
positive reinforcement produces significant differences in the amount of improvement in 
academic performance. This is done by the J-N technique’s provision of lower and upper 
limits of a region of nonsignificance, outside of which region criterion scores are 

significantly different (See Figure 2). 

The J-N technique is often used as a superior alternative to the analysis of 
covariance (ANCOVA). This is due mainly to the fact that, while the J-N technique 
shares almost all of ANCOVA’ S assumptions, it can be used effectively when 
ANCOVA’s assumption of homogeneity of the slope of regression is not met. With the 
exception of the homogeneity of slopes assumption, the J-N technique shares all of the 
assumptions of ANCOVA (Pigache & Graham, 1976). These assumptions are: 

1) The regression of Y on X is a linear relationship. 

2) Variances for each value of X are equal (homoscedasticity). 

3) Within-group variances are equal. 

4) Homogenous variance exists across treatment groups. 

5) The measurement of the covariate is error-free. 

6) Carry-over effects related to measurement are independent. 

7) In the regression of Y on X, there is regression toward the mean (normality). 

8) Departures from the regression line are independent. 

The J-N technique, as noted by Huitema (1980), is also an optimal choice to either a 
factor analysis of variance (ANOVA) or simple main effects tests because of the J-N 
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Figure 1. Academic performance plotted as a function of positive reinforcement. 
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Figure 2. The J-N technique’s provision of a region of nonsignificance, v.^here LI and L2 
are lower and upper limits, respectively. 
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technique’s superior power and its allowance of the examination of treatment effects for 
different covariate levels. Given the J-N technique’s value in such cases, it has been used 

inavariety of applications since its development in the 1930’s. * 

One valuable application of the J-N technique has been in studies where 
researchers are interested in pre- and post-test differences in the effectiveness of 
alternative teaching methods (Ceurvorst, 1979). A study of this type by Keim- Abbott and 
Abbott (1977) examined the interaction of student characteristics (trait) and teaching 
method (treatment). Upon analysis of the data a significant trait-by-treatment interaction 
(TTI) was found. Based on this significant TTI, the J-N technique was then utilized to 
determine the regions of significant difference in the criterion variable as a function of the 
predictor variable, and results indicated that a teacher-paced method of learning produces! 
significantly higher levels of achievement in students than a self-paced method of 
learning. Another area in which the J-N technique has been similarly applied is the area 
of learning disability research. One such study examined the advantages of the J-N 
technique (with respect to accuracy) over ANCOVA in analyzing regression differences 
in standardized scores of learning disabled and normal children (McLeskey & Rieth, 

1982). Results of this research indicated that the J-N technique was in fact more accurate 
than ANCOVA at depicting areas of significant difference. 

Researchers have also found the J-N technique useful in determining differential 
prediction for both race and gender in academic and technical programs. In one study 
done to examine differential prediction of selection for military programs by race, the J-N 
technique was found to be highly effective in reducing bias that may occur using other 
methods of regression analysis (Houston & Novick, 1987). Related to gender, Gamachs 
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and Novick (1985) showed the J-N technique to produce effective identifications of 
regions of significance that would otherwise (using other techniques) exclude students 
from selection to certain programs based on gender. Finally, the J-N technique has befifr 
of great assistance to those doing research in clinically related fields. A study by Pigache 
and Graham (1976) noted the J-N technique’s particular usefulness in helping to examine 
the contribution of baseline levels to treatment effects, as in the baseline level of a drug 
affecting the level of the criterion variable. 

In the many years since the J-N technique’s development, this procedure has 
undergone numerous changes. One area of change has been the attempt of researchers to 
bring the J-N technique into the computer arena. As noted by Ceurvorst (1979), the J-N 
technique has not been widely taught or used over the years because of its requirement of 
lengthy computations. The past unavailability of the J-N technique in most statistical 
software thus left researchers with three options: enduring the computational tasks 
involved in using the J-N technique, finding alternative methods of analyzing regression 
slopes, or developing computer programs to put this technique to work in their studies. 
Some opted to undertake the job of developing a computer program for the J-N technique 
to use in their research. 

The programs written vary along certain lines, such as the type of system on 
which they may be used, language (e.g. FORTRAN), and the number of variables that 
may be used in the program. Karpman has designed several J-N programs, one of which 
is an ANCOVA program that proceeds to the J-N technique when it is determined that 
there is heterogeneity of slopes. This program is limited to six groups, and output consists 
of the results of multiple comparisons and a definition of regions of significance 
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(Karpman, 1980). Karpman later devised a program for use with SPSS-X or SAS (1986). 
This program requires input of slope, intercept, covariate sums of squares, covariate 
mean, sample size, critical F-value, and the pooled residual sum of squares for the 
criterion for each group. The output yields regions of significance and can be plotted 
using the PLOT procedure on SPSS-X or SAS (Karpman, 1986). Both of these Karpman 
programs were designed for use in the one covariate case. Earlier, Karpman (1983) wrote 
a program for use with SPSS or BMDP that could also be used in the two covariate case; 
however, this program can not produce exact regions of significance. Instead, regions of 
significance are approximated through the use of confidence tests at each value of the 
covariate. Such difficulties as this have most often left researchers to design J-N 
programs for use in the one covariate case. 

Scialfa (1987) developed a BASIC program for the J-N technique. This program 
requires the input of the following parameters for each group; predictor mean, standard 
deviation, sample size, residual sums of squares, the least estimate for slope, and the least 
squares estimate for intercept. These data may be calculated using virtually any major 
statistical software package. In addition, the critical F value is needed, with 1 and N-4 
degrees of freedom (df), where N = combined sample size (Scialfa, 1987). The output for 
this program consists of values for the point of intersection and the two regions of 
significance. This program is designed to employ the J-N technique in cases where there 
are two groups and one continuous predictor. 

Computer programs for the J-N technique have also been written in FORTRAN. 
Ceurvorst (1979) devised a FORTRAN V program that requires input in much the same 
manner as SPSS. Separate “control cards” are entered for variable names, format of 
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input, number of groups, and an alpha level (per-comparison) - required for constructing 
regions of significance. “Data cards” follow, and an output is produced that gives the 
following information for each group; number of cases, mean and standard deviation (fOT^ ^ 
both variables), correlation and regression coefficients, and regression line intercept on 
the dependent variable axis. In addition, the F-ratio for homogeneity of regression (with 
degrees of freedom and probability) are shown, along with a printout of the point of 
intersection for the regression lines (if one exists). This program is designed for J-N 
comparisons between as many as 20 groups, with one independent variable and one 
dependent variable (Ceurvorst, 1979). 

Another FORTRAN program was designed by Pigache and Graham (1976) for 
the purposes of researching pre- and post-treatment effects of drugs, with consideration of 
baseline levels. In this program data are entered related to minimum and maximum pre- 
treatment values, the number of treatments, and the number of participants. A second area 
of data entry contains pre-treatment values for treatments 1 and 2 and participants 
through value n. These data are immediately followed in the program by the post- 
treatment numbers for all participants and treatments. From this, two sets of output are 
obtained. The first output yields the pre- and post-treatment means for each regression 
line, the correlation coefficient, the t-value, the slope, and the intercept on the criterion 
variable axis. The second output shows information about the treatments and their 
comparisons, as well as related significance levels (Pigache & Graham, 1976). It is 
important to note another aspect of this study - the researchers’ modification of the J-N 
technique. The technique was modified so as not to assume equal variances. This 
modification consisted of two major stages; estimating the regression line of post- 
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treatment on pre-treatment level separately for each of the treatments together with the 
slope’s standard error, and superimposing a series of intercepts along the pre-treatment 
axis of values (Pigache & Graham, 1976). For the purposes of the study, this appears to^^^ 
be an effective J-N technique modification. 

Although similar modifications of the J-N technique have been done, overall 
research on the J-N technique has been somewhat limited. Hunka (1995) has done 
research in the area of the J-N technique, pointing out that this technique has limitations 
related to many things: the number of groups and covariates, the nature of the regression 
model, the use of confidence intervals or confidence regions in determining boundaries 
for the co variate, and whether or not actual regions of significance can be obtained in the 
case of two or more covariates. As a result, Hunka developed an alternative to the J-N 
technique by “cast[ ing] the analysis into the form of a general linear model,” 
representing the unknown boundary values for the covariate in symbolic form on a 
contrast matrix, and solving the matrix equation for the sum of squares (to determine 
significant group effects) using the Mathematica software system (Hunka, 1995). Hunka 
also provides examples of how this technique can be used effectively in the case of more 
than one covariate. 

Other research on the J-N technique was done by Chou and Huberty (1992). In 
this study, the authors set out to test the original J-N technique compared to the 
modification designed by Potthoff (1964). Potthoff s modification of the J-N technique 
was done so as to create simultaneous regions of significance, and similar work was later 
done by Rogosa (1981). Chou and Huberty’s research consisted of examining the 
robustness of the original and modified J-N techniques in relation to controlling 
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simultaneous error rates. Monte Carlo simulations were performed (manipulating 
conditional distribution shape, conditional variance ratio, and sample size ratio) to 
evaluate the techniques’ relative ability to control the Type I error (identifying a region of 
significance when in reality none exists) and Type III error (when the identified region of 
significance contains a covariate value at which the expected criterion score for two 
groups is equal) (Chou & Huberty, 1992). Results showed that the modified J-N 
technique effectively controlled the Type I error rate and both techniques controlled for 
Type III error; however, it was found that the original J-N technique was not effective at 
controlling for Type I error under most conditions (Chou & Huberty, 1992). The 
researchers then used ANOVA to deteraiine the effect of the three factors that were 
manipulated (in the Monte Carlo simulations) on the respective error rates. The following 
was determined: virtually no effect for conditional distribution shape, and virtually no 
effect for conditional variance ratio when sample sizes w'ere homogeneous. When sample 
sizes were different, a large conditional variance ratio effect appeared (Chou & Huberty, 
1992). 

The current problem is related to previous work done by Lavender and Kim 
(1996). This study examined differences in predicted (based on ACT-C scores) college 
grade point average (CGPA) across gender. In order to determine what, if any, significant 
gender differences existed, the authors performed analyses using the J-N technique. This 
technique was then extended to examine gender differences in CGPA across various 
college majors. This was done in an attempt to determine whether or not differential 
course selection plays a part in gender differences across CGPA. Findings indicated ±at 
differences in CGPA did exist across gender for the entire sample, but that these 
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differences were minimized when controlling for college major (Lavender & Kim, 1996). 

In performing the analyses for this study using the J-N technique, Lavender and 
Kim encountered some problems. Regions of significance were found using the J-N 
technique in the college majors of Finance and Psychology; however, these results 
contained anomalies. For both majors the nonsignificant regions identified by the J-N 
technique did not contain the intersection of male and female regression lines. This is 
then taken to mean that the intersection of the male and female regression lines occurs 
within a region of significance; however, this can not be true since the male and female 
regression lines can not differ significantly at their point of intersection (See Figure 3). 
These anomalies fall into the category of what was defined above as Type III error. It was 
speculated that Lavender and Kim’s (1996) resultant anomalies are related to the J-N 
technique’s condition of equal sample sizes and assumption of equal variances between 
two groups. When examining how the sample size and variance can affect results in such 
a way, one must consider the formulas involved in the utilization of the J-N technique: 
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In t±iese formulas, F is equal to the tabled F ratio (with 1 and N-4 df). N is equal to the 
total number of participants (number of participants in both groups combined), while n, 
and are equal to the number of participants in groups 1 and 2, respectively. The ss„j 
represents the residual sum of squares for the regression analysis with both groups 
combined using a dummy variable, or pooled ss^^^ for the separate regression line of both 
groups. X, and are the means for groups 1 and 2 (respectively) of the independent (X) 
variable. The values represented by b, and b, are the regression line slope coefficients for 
groups 1 and 2, respectively; a, and a 2 are the regression line intercepts for groups 1 and 
2, respectively. Finally, Zxh and Zx\ are equal to the sums of squares for groups 1 and 
2, respectively (McLeskey & Rieth, 1982). As can be seen in equations (l)-(3), the 
variance plays an important role in J-N computation. The population variance is directly 
related to the sample sum of squares, since the sample variance is an unbiased estimate of 
the population variance and the sum of squares is the product of the sample variance and 
degrees of freedom. Thus, the variance’s close relationship to the sum of squares may 
affect the results of computation when using the J-N technique, if the assumption of equal 
variances is violated. 

With respect to the equal sample sizes property, it can also be seen how violation 
of this condition could potentially affect results. In the above-listed equation (3), the 
inclusion of n, and n, in the computation creates the possibility that unequal sample sizes 
could cause anomalies, as in the case of Lavender and Kim’s study (1996). Unequal 
values of n, and n, could also produce flawed results considering n’s involvement in the 
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College GPA 




ACT Score 



Fieure 3. Type III error produced by the J-N technique, as in the case of Lavender and 
Kim’s (1996) research. 



er|c 



’’15 



Sample Size, Variance, and the J-N Technique 13 



formula for the sum of squares (in conjunction with the sample variance), as can be seen 

in the following: 

= s-(df), 
where df = n-1. 

The purpose of this study was to examine exactly how manipulation of ratios 
related to sample size and variance affects results when using the J-N technique. The 
advantage of this approach over other approaches (such as using a hypothetical data set) 
is that it provides more accurate information with respect to what component(s) of the 
formulas may affect the outcome of the J-N technique. 

Method 

Monte Carlo simulations were performed to manipulate various situations of 
sample size and variance. First, the J-N technique was performed on data to simulate 
equal sample size ratios, these ratios being paired with both equal and unequal ratios of 
variance. The J-N technique was then performed again with unequal, sample size ratios, 
which were in turn paired with both equal and unequal variance ratios. Equal ratios for 
both sample size and variance were represented by the following values; 10:10, 20:20, 
30:30, 50:50. Unequal ratios were: 10:20, 10:30, 10:50, 50:10, 30:10, 20:10 (See Figure 
for a more detailed design of the study). In performing these analyses, areas in the 
computational formula that do not include the sample sizes and the sums of squares 
(affected directly by variance) were kept constant, as shown here: 
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Figure 4. Manipulation of sample size and variance ratios. 
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where areas in bold indicate areas in which values were held constant. Regression line 
equations of y = I + x and y = 3 - x were used for groups I and 2, respectively; therefore, 
the intercept produced in each case was one. For each simulation, a modified version of 
Lavender and Kim’s (1996) original SAS program for the J-N technique was used. The 
program used is located in Appendix A. 

Results 



The results of this study consist of regions of nonsignificance calculated by SAS 
for each of the 70 cases included in the Monte Carlo simulations (See Appendix B). None 
of the cases produced anomalies, with each simulated situation yielding an intercept of 
one, and lower and upper limits below and above one, respectively. It was further noted 
that the resultant regions of nonsignificance varied in size according to the different 
m ani pulations of sample size and variance ratios. 

Tlie results show the J-N test to produce the largest amount of variation in 
accordance with total sample size, since the smallest regions of nonsignificance (and 
consequently the largest regions of significance) were produced in the series of 
simulations where the sample size ratio was 50;50. Specific evidence for the unportance 
of total sample size can be seen by first exainiiiing the case in which the sample size 
ratio=50:50 and the variance ratio=l0: 10, versus the case in which sample size 
ratio=l0;l0 and the variance ratio=l0;10. The former case resulted inXLi=.88883 and 
Xi_ 2 = 1.11117, with a region of nonsignificance of .22234 (obtained by subtracting -he 
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lower limit from the upper limit); the latter case resulted in Xli=- 33548 and Xl 2=1. 66452, 
with a region of nonsignificance of 1.32904. The smallest region of nonsignificance was 
produced for the case in which both the sample size and variance ratios were 50:50, 
resulting in Xl,=. 88888 and Xl 2=1.1 1 1 12, with a region of nonsignificance of .22224. 
Comparing the results of this case to those of the case in which the variance ratio 
remained 50:50 but the sample size ratio=10:10, where Xl,=. 34815 and Xl 2=1.65185 
(region of nonsignificance=l. 30370), one can again see the effect of total sample size. 

Final evidence for the importance of total sample size in using the J-N technique can be 
seen by comparing the cases in which the sample size ratios were 50:50 and 10:10, 
respectively, while the variance ratio was held constant at 10.50. In the first case (sample 
size ratio=50:50, variance ratio=10:50) Xli=. 88886 and Xl 2=1.1 1 1 14, with a region of 
nonsignificance of .22228, versus the second case (sample size ratio=10:10, variance 
ratio=10:50), where Xl, =. 34190 and Xl 2=1 -65810, with a region of nonsignificance 
1.3 1620. Overall, the smallest regions of nonsignificance were found in the cases in 
which the sample size ratios were 50:50, while the largest regions of nonsignificance are 
found in the cases where the sample size ratios were 10:10. 

Size and equality of variance ratios seem to have played a minimal role in 
determining these results, based on cases in which the sample size ratio was held constant 
at 10:50 while manipulating the variance ratios to 50:50, 10:10, and 10:50. In these cases 
the resultant regions of nonsignificance were very similar in size. For the first case 
(sample size ratio= 10:50, variance ratio=50:50) Xl,=. 74532 and Xl 2=1. 25468, with a 
region of nonsignificance of .50936. For the next two cases in which the sample size ratio 
remained 10:50 and the variance ratios were 10:10 and 10:50, the regions of 
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nonsignificance were .51080 and .51058, respectively. The results of these three cases (in 
which both size and equality of variance ratios were manipulated) fall in the .50936 to 
.51080 range, indicating the minimal importance of variance ratio size and variance ratio 
equality. 

These cases also provide further evidence for the strong effect of total sample 
size, even when sample size ratios are the most unequal (10:50). This can be seen when 
comparing the case in which the sample size ratio=10:50 and the variance ratio=50:50 
with the case in which the sample size ratio=10;10 and the variance ratio=50;50. As 
mentioned, the former case yielded Xl, =. 74532 and Xi^=l .25468, and the region of 
nonsignificance=.50936. The latter case, in which the sample size ratio was both equal 
and as small as possible (10:10), Xu=.34815 and Xl 2 = 1.65 185, with a region of 
nonsignificance of 1.30370. So the case in which the total sample size is larger (10:50) 
produces a much smaller region of nonsignificance than the case in which the sample size 
is smallest (10:10). This also provides evidence for the limited importance of equality of 
sample size ratios in comparison to the strong effect of total sample size. The general 
trend seen in these results is as follows: regardless of equality of sample size and variance 
ratios, and regardless of size of variance ratios, regions of nonsignificance are inversely 
proportional to total sample size. 

Discussion 

The results of this study indicate that the J-N technique will not produce 
anomalies in results due to differences in sample size or variance between groups. Each 
of the cases simulated in this study resulted in valid regions of aonsignificance, with 
lower and upper limits surrounding the point of intersection. For the purposes of this 
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study, “best case” results were determined by the yielding of the smallest regions of 
nonsignificance, which in turn produce the largest regions of significance. The best cases 
were found when the total sample size was largest, while the worst case results occurred . , 
when the total sample size was smallest. Thus, it appears that the most important factor m 
determining the J-N technique’s sensitivity is overall sample size. Size of vanance did 
have some effect on the results, since the best overall results were obtained when both the 
sample size and variance ratios were 50:50; however, even when the variances were 
smaller and the sample size ratio was 50:50, the results were still very similar. 

Another factor that was shown to be of limited importance in increasing the J-N 
technique’s sensitivity was equal ratios. As previously mentioned, the best results were 
seen when both the sample size and variance ratios were 50:50. In the cases where the 
sample size ratios remained 50:50 but the variance ratios were made unequal, the results 
were still very similar (yielding small regions of nonsignificance) to when the vanance 
ratios were equal. It appears, therefore, that the equality of variance ratios did not have a 
large impact on the results. When the sample size ratios were made to be unequal, results 
were significantly affected; however, this trend was likely due more to an overall 
reduction in total sample size than inequality of sample size ratios. So it can be said that, 
based on these results, the most important factor in determining the J-N technique’s 
sensitivity is total sample size, with higher sample sizes producing the best results. 

Little research has been done specifically related to the effect of sample size and 
variance on the J-N technique. Pigache and Graham (1976) modified a J-N FORTRAN 
program to eliminate the assumption of equal variances between groups - a modification 
that improved the results of their study. Hunka (1995) noted that problems exist with the 
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J-N technique and its production of anomalies in results; however, his research was 
related to the anomalies being due to variation in the number of groups and co variates, 
the nature of the regression model, and the use of confidence intervals or regions m 
determining covariate boundaries. The research done by Chou and Huberty (1992), based 
on Potthoff s (1964) and Rogosa’s (1981) modifications of the J-N technique, was (as in 
the case of this study) aimed at trying to prevent Type III error rates in using the J-N test. 
Their research, however, was focused on comparing the effectiveness of the original J-N 
technique at controlling simultaneous error rates to a modification of this technique 
(Chou & Huberty, 1992). 

The authors of the current study have attempted to prove that differences in 
sample size or variance ratios are the culprits in creating J-N technique anomalies. The 
results of this study indicate that differences in these ratios can not be exclusively 
blamed, no matter how much of an impact sample size and variance seem to have on tb.e 
calculation of the formulas involved in using the J-N technique. Anomalies may be the 
result of some other portion of the J-N technique’s formulas, and further research should 
be done to continue ruling out components of these formulas. Another possible difficulty 
with the current study was that specific cases of sample size and variance ratios may 
interact poorly with any number of components in the formulas. The case may exist in 
which an unequal sample size ratio interacts poorly (and produces anomalies) with 
another component of the formulas only when that component has a value in a certain 
range. Ideally, further research should be done to manipulate all of the many factors 
included in the J-N technique’s formulas. 
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This research is of value in that it has revealed what factors increase the 
sensitivity of the J-N test. Based on the results of this study, researchers can obtain J-N 
technicjue results even when sample sizes and variances are different between groups. ^ ^ 
Better results may be produced, however, by increasing the total sample size and keeping 
the sample sizes between groups as equal as possible. How equal the groups’ sample 
sizes need to be is a final research question created by this study. Performing simulations 
again using such sample size ratios as 20:50, 30:50, and 40:50 may help to determine the 
exact importance of sample size equality in using the J-N techmque. 
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Appendix A 

SAS program used for Monte Carlo simulations manipulating sample size and variance 
ratios: for each case, appropriate variable values were changed in lines 00001 and 00015 

00001 title “Monte Carlo for J-N n=l 0/10, var=10/10”; 

00002 datamcsim; 

00003 input f ssres al a2 bl b2 nl n2 nt xbarl xbar2 varl var2; 

00004 ssl=varl*(nl-l); ss2=var2*(n2-l); 

00005 

00006 a=(-f/(nt-4))* ssres* (( 1/ss 1 )+( l/ss2))+(b 1 -b2) * *2; 

00007 b=(f/ (nt-4)) * ssres* ((xbar 1/ss 1 )-i-(xbar2/ ss2))-i-(a 1 -a2)* (b 1 -b2) ; 

00008 c=(-f/(nt-4))*ssres*((nt/(nl*n2))+(xbarl**2/ssl)+(xbar2**2/ss2)) 

00009 +(al-a2)**2; 

00010 

0001 1 xl=(-b-sqrt(b**2-(a*c)))/a;c)))/a; 

00012 

00013 ■ ints=(a2-al)/(bl-b2); 

00014 

00015 cards; 

00016 

00017 4.49 30 1 3 1 -1 10 10 20 1 1 10 10 

00018 ; 

00019 proc print; 

00020 var xl xu ints; 

00021 run; 
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Appendix B 



Results of Monte Carlo simulations rnaninulating sample size and variance 




Sample Size Ratio 


Variance Ratio 


Lower Limit 


Upper Limit 


Intercept 


Equal 

10:10 


Equal 

10:10 


.33548 


1.66452 


1 


10:10 


20:20 


.34348 


1.65652 


1 


10:10 


30:30 


.34609 


1.65391 


1 


10:10 


50:50 


.34815 


1.65185 


1 


Equal 

10:10 


Unequal 

10:20 


.33952 


1.66048 


1 


10:10 


10:30 


.34085 


1.65915 


1 


10:10 


10:50 


.34190 


1.65810 


1 


Equal 

20:20 


Equal 

10:10 


.70605 


1.29395 


1 


20:20 


20:20 


.70672 


1.29328 


i 


20:20 


30:30 


.70694 


1.29306 


1 


20:20 


50:50 


.70712 


1.29288 


1 


Equal 

20:20 


Unequal 

10:20 


.70639 


1.29361 


1 


20:20 


10:30 


.70650 


1.29350 


1 


20:20 


10:50 


.70659 


1.29341 


1 


Equal 

30:30 


Equal 

10:10 


.80996 


1.19004 


1 


30:30 


20:20 


.81013 ' 


1.18987 


1 


30:30 


30:30 


.81019 


1.18981 


1 


30:30 


50:50 


.81024 


1.18976 


1 


Equal 

30:30 


Unequal 

10:20 


.81005 


1.18995 


1 


30:30 


10:30 


.81007 


1.18993 


1 


30:30 


10:50 


.81010 


1.18990 


1 . 


Equal 

50:50 


Equal 

10:10 


.88883 


1.11117 


1 


50:50 


20:20 


.88886 


1.11114 


1 


50:50 


30:30 


.88887 


1.11113 


1 


50:50 


50:50 


.88888 


1.11112 


1 
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Equal 


Unequal 








50:50 


10:20 


.88885 


1.11115 


1 


50:50 


10:30 


.88885 


1.11115 


1 


50:50 


10:50 


.88886 


1.11114 


1 


Unequal 


Equal 








10:20 


10:10 


.56784 


1.43216 


1 


10:20 


20:20 


.57003 


1.42997 


1 


10:20 


30:30 


.57075 


1.42925 


1 


10:20 


50:50 


.57132 


1.42868 


1 


Unequal 


Unequal 








10:20 


10:20 


.56855 


1.43145 


1 


10:20 


10:30 


.56878 


1.43122 


1 


10:20 


10:50 


.56897 


1.43103 


1 


Unequal 


Equal 








10:30 


10:10 


.65999 


1.34001 


1 


10:30 


20:20 


.66106 


1.33894 


1 


10:30 


30:30 


.66141 


1.33859 


1 


10:30 


50:50 


.66169 


1.33831 


1 


Unequal 


Unequal 








10:30 


10:20 


.66024 


1.33976 


1 


10:30 


10:30 


.66033 


1.33967 


1 


10:30 


10:50 


.66039 


1.33961 


1 


Unequal 


Equal 








10:50 


10:10 


.74460 


1.25540 


1 


10:50 


20:20 


.74505 


1.25495 


1 


10:50 


30:30 


.74520 • 


1.25480 


1 


10:50 


50:50 


.74532 


1.25468 


1 


Unequal 


Unequal 








10:50 


10:20 


.74467 


1.25533 


1 


10:50 


10:30 


.74469 


1.25531 


1 


10:50 


10:50 


.74471 


1.25529 


1 


Unequal 


Equal 








50:10 


10:10 


.74460 


1.25540 


1 


50:10 


20:20 


.74505 


1.25495 


1 


50:10 


30:30 


.74520 


1.25480 


1 


50:10 


50:50 


.74532 


1.25468 


1 
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Unequal 


Unequal 








50:10 


10:20 


.74498 


1.25502 


1 


50:10 


10:30 


.74511 


1.25489 


1 


50:10 


10:50 


.74521 


1.25479 


1 


Unequal 


Equal 








30:10 


10:10 


.65999 


1.34001 


1 


30:10 


20:20 


.66106 


1.33894 


1 


30:10 


30:30 


.66141 


1.33859 


1 


30:10 


50:50 


.66169 


1.33831 


1 


Unequal 


Unequal 








30:10 


10:20 


.66080 


1.33920 


1 


30:10 


10:30 


.66108 


1.33892 


1 


30:10 


10:50 


.66129 


1.33871 


1 


Unequal 


Equal 








20:10 


10:10 


.56784 


1.43216 


1 


20:10 


20:20 


.57003 


1.42997 


1 


20:10 


30:30 


.57075 


1.42925 


1 


20:10 


50:50 


.57132 


1.42868 


1 


Unequal 


Unequal 








20:10 


10:20 


.56933 


1.43067 


1 


20:10 


10:30 


.56982 


1.43018 


1 


20:10 


10:50 


.57021 


1.42979 


1 
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